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ABSTRACT : PROBLEM TO BE SOLVED: To achieve speech recognition of plural speakers with high 
reliability. 

SOLUTION: This system is configured of a speech signal input part 1 , a video signal input 
part 2, an unspecified speaker speech recognition part 3 for extracting a common feature 
from speeches of multi-speakers, making a standard pattern, and calculating a degree of 
similarity between the input speeches and a standard speech pattern, a specific speaker 
speech recognition part 4 for calculating a degree of similarity between the input speech 
and the speech of a pre-registered speaker, a face region extracting part 9 for extracting a 
face region from an input video, a face image database 1 1 for recording face image data 
of plural specific speakers and their identification numbers, an image comparison part 10 
for outputting the degree of similarity with the image data inputted from the face region 
extracting part 9 and the face image database 1 1 , and a recognition result integration part 
5 for calculating an integrated degree of similarity from the outputs of the unspecified 
speaker speech recognition part 3, the specific speaker speech recognition part 4, and the 
image comparison part 10, and outputting the recognition result. 
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? *\D+&imwmt . mgo^pT-? *a 
2nn.w*jj*at. 

%mm mt t i> izmm t . mmztitz&pT-? t x 
■tiik^ir-'? t comimzw-iii Lx^mmzn o mm 

hx-h^f—? bcom®M*%d!, Lx^mm* m 

t mm®.?-? izisztih mmcom&T-? t com.®. 

pM&mmt LxMmmztats^^imm^m^^mb 

mmonptT-? SA^-rs wi^A^ak . 

k migBii5«r-^ K&$.tih m%comm?-? b comu 
mzn &-r&wmmfr®b . 

mb b uzm^L. mmwmmm^&x°%iii2tiKmM 

fe*hb iutW^x-* 0 SLUSL -to 
& 0 S^it/cW^x-? 4: A*W^x- * k <031&lg£ 

saj Lxw^g^srff a , ?m 

wmttf-ytfttiL. sblx. mjzmm>*?->bx 

ffi* Sit* SHKflW) 3 hW&b a 

-tcoMzMLx. x-ft^?-? bcr>mm.*%&-t 
1 fcrsaaosmsaaai. 

fcA*i^fc**ii4Bfl^-*k<0»WS*RU » 



jffiftm^^ Sit * . K*»8«f«fc*f 

m-tzm^o^pT-? j imthx*^?—? b<r> 

SfflH**R'i.j. WiaS#*?»Ba¥«*'4>tMjSft 
4 . XJjM^T—f b W*T j k OSHKSS: R J * k 
-fSfctK. ^O Ri k R'i.j b R"j k£fflwt 

1,3. 40V^^fi3Wc|g«OWWBiWai. 

0«0#o»S«3&*Ute$iUtBM J: 0 v>A:flfc» 
LTO*. XJiWjBt- * b fig^r - * OJHEUS £ 

MAASBk. K#<0Wi»x-**A^4**A*« 

hfzmmzmz.x^zmz\±, xijimwzmmvvm 

[»*«8] S^OMSr^trtMR-r-^iAiJ-f-fttt 
«A*SI5fc. S#0^7 r -^?rA*-ri.^A^SE 

#at. A*^*^^^^sr^aj-r-s»^^^ 

k . *ffl«H«)fc 0 «f«i # *k 

tt«+fcR«o«aw**4 itxv > « £ k $:*-ns#^a 
jsf-^oaflweijtasf 4 - k $:!msk-r4if*Ji 

1 . 3 - 6 60V vma»fcERtf»W8«EH • 

[ If 9 ] ^fI-§A#aSk B*mfi-^A^M(i. * 

mx-zzmmmmMmz-kt!* &mmmmzxji-r?> 

B«^SS35Ttt. «HR$iufeai«#oB*i:A*Lfc* 

«fi#tc**it*»#oB«k comm.*%&~?z> ; k 

$r#l£k-r4ff^Sl . 3-6. 8CHW*il7WcfetK<0 

A^-rs^fiiA^gPk. mvnm%<nmm9m<m& 

W*W&T**R«WflWii:*(5:«W-*B« 
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t fts fs^s^x-? t <Qmmzn.ft-t& m&wm 

£B«-f-*?OTlK£3iai U g&ZtiX^Z-f't.X 

a. 

juts*? -?<vwm&'g. m l . ft* ztitzm&gtf 
"fsbwcg. Ltzmms i atk^zgimmv-t^xco^ 
j5T-?izttLx. ®^%^mw&®.frt*fttt& 

ff?*r-*i: L/C, *ft£#5re# SfS^fSifliM&i: £: 

[fiajofSSH&l&BJ!] 

[000 1] 
[0002] 

^k^mim^izisM&v&ktfhh. nmm^com^ 

^#>s#isu Ajrgpk&m^pcomM&zn.ftL. a 
j]MP?e>imz'i7oi><DX'h&. ^-c. smtLtzm 
%crfejsxt>iztt lxh. is^tmmz'&& Z k tfTZ 
&t>K m^ffm^^m-h^m^^k^h. 

jzwm>*?->kcrmw&*%ftL. xxmisommi 
n?i>cr>x'*>&. iot, m^^jzzm&hmmz 



[ o o o 3 ] z\<r>£ o ilt^^^lgiS^fc^ 

*>. ftjmmMmmttkTmymz^pimjTf&z 
mm^&izmmgkwmthixx^h mmm>i-32 

[0004]^ coigwiia 6 kstt i o iz. 
xDfh^jsm^x-ftm, ^ftmfcg^mmjfjtiz 

J: 0 **B»£fr 7 ^#S£iS*fSftBS& 3 . «5£l&&^ 

^smgtmis® k mim%msmx'zti?ixmz ~> 

zftgmzmmmk Lx<ffim%mm4izm&t&. 
[ooo5] z<7)Xoiz. mkw^mmgwximz. 
mm^^mmjj^k^^m^pm^immi-i, 
zkizi*). mm^esmim^. »«ok 
mcDizpT-?* mm^m-hzkim^k %~>x 

[0006] 

T^iM* s #i.ioix-g»^\ mmftxwa-r&n&izn. 

[0007] ^BJ{±, C^.id^^iTti.StcT) 
[0008] 

reKTCWL K*^»f»»HR < »5r if) Sr-^tf^M^ 
-^SrA*-r««MRA»*Ht. K*^>^^-^^A 

■h^h^px-nmsLk . ^s«imaiBi^i: 

mmmft-ttmsmmft^^k. Bm*ffimm&!s 

-xk. mwmft^m^ft^ixhwm^kmm® 
T-f^-xizwmzhf^MMisikzitnLx. mm. 
zftjj-rzmmim^mk. *&%.m&g?*mw&®k 

upkAjj^pk <7M<mmLk mmsm-m^ft-n 
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[00 0 9] &tz. *J»t— MHt&T-?^ 

T^m&^imw&m^<n\hXbmmmmz±z < 

L . «»3 *ufc»#0tfOHR k A* Ltim%cr>WM 
jtfKW^fc:*:* *»*>1$£IS*, * 

[00 11] 

[fffiB<^S»0JBJB] *^BJ<r,|t^I 1 KfeftofSBJl 

wct~? * tjj-t 4**a**« t . mgvygj*?- 

t-?z. t*i**£-r» &m%mmmb t t>tza* 
l. aai^ftfc^-f- 9 1 aji^p-t- 9 t comim. 

Aa^r-* fc oaaxft** m vx^pnmzn 3* 

b. ®im^fZim^&coft*b*ftimm^fzmiSi 
*aa» ^oas* nasa^R** 6 <9ffl* i: fctt* L 

xaij}7zcrmp®m&&z&z. s c k £ i o , 

[0012] *5M8^>as«3H2 waa^sHWi. #j*b 

&B!lW&A;>J#Kk. S^^T-'-^SrA^-fSW^A 
fcWJTCS l>f&&i&S'H1?#Bk fc fcfcfiffcU a»§*ifc 



m%<0^pT-f£. *ti£ft%.X*Z&fflBibbhiz& 

%mtx. ^wms^-ybAii^T-? 

^B«¥BW»<9 Offl* k UT , Wj*Sttttft k L 

T#s**ffi*^*BJWSJRtt*¥Kk £«*.fcfc«re 
hK>. mb£&wmfrt>m%<owmmmtiiLx. 
%mzntcm%cDmwigi'T-?<-xbm.i* l . mm. 

Lxmm&mz mjj-r&z k tc«fc *) . mmcr>&%M%cr> 
b%&b^oftmzm-&. 

[0013] *IMB<0l9««3*=ffia<0fMHli. It^l 

iieao»?»Bi»aifc:*v^r. «see««^BMma 

tzzfr&^pT-fcoMzttLX . Ajim?*T-?b<7) 
[0014] *f6HB09W»«4fc:Btt^)»H|!li, IS*^ 
X'ii , B«B»^Bb^ ^ tti^l S ixl»a<aJSco 5 *>SAk 

c^aiags- J: a iz lx. l <nxh h . 

[0015] 3WMB<0BWOT5(cE*l<^)«B|itt, lf*« 

i. 3, 4w-rhfriziffi<vu?mmmiz&^x, 

%mimmzttj&-r&mmcommT-? tAtwmtz^ 
£ti&w®.T-? b vmsmz Ri , mtt&smvm 

Fx- ^ J A^^x- ? k <^BHEIK«: R ' i . 

J. ^»Jg»#«J*W¥R*»4>ttl^*tL*, A^J^F 

-eeo Ri b R'i.j k R"j k £fflwcfiji 3 5rt;&-f 

[00 1 6 3 *^aj^it*JS6^ieiiO^{i. It*^ 

mtcb<m* &tsftmzm%?mmwm 1 a^b* 

»* { S^§^B9MJ:0i.A#V^A^^L-C^. A 

^i*^-*bm^i2^-?<nmm&%&th&o 

HzLtzhnXhh . 

[00 1 7 3 *IMH^»*fll7tcEtli05HHtt, S«tt 
tti^Bk LT. fg#c?)^Sr-^tf^T-^SrA^-ri>^ 
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* k «J»l^Ao69«c»Jg3 *ifcB8ffi£j@;fC v ^ 
ttfcli* AASftfc^+fcS^afcfca^iflTV^ 
£ k £^-ff&t&tUff-^£ W**-* k f^ffl5r w-r 

[0018] **HJtfDM««8fclEa<0»Wi, 

it ** 7 ££*Kais#ifttb£gk RtteotngS' w-r sis 

[0019] *JKa<0BHWI9tciea<0*aWi. IMW 
1, 3~6. 8avvfft^EttaffmHNaUc£V* 
Ts #}*m#A*»fcWMWJj|«i. *fi**UIMR 

A^&k. ai*««fR*ie»r*ffii»«fl!«iE«¥« 

[0020] *3fcBJ!0>|g#« 1 0 fcEBtftfHHtt, as* 

k. &»<of^ojt«^i«tf>B«£. **.*f#5rc3 
-i.|g#i^ijfflfgk*{cSlii-rsB«T-^<-xk, « 

»§:h.fcHttr-* k A*W*fc:***i4IS#tf>B*-r 
-*fc<^tUS**ffir*B«K««#«k Sr*£fc«>«0 

14. *§lt<7>f&&k LT*fc*K#«5!lfll*fc k & tea 

[0021] 1 1 iz*m<7)ftm±. m. 

mi, 3-6. 8. 9n\vrivtptzm<ttmmam 

BfftieiMMa&Sffl tfzhco-ch o . 3fcti« 
is** nmuz^m-h C k tc J; 0 f-?^-x«^ 
friO^Se&kudfftBSvTfS. 
[0022] afs»jJi*>at*JH 1 2 fctBttOWJHi. SI& 

* 1 1 imeygmmmmiz&^x . a* ttztm^ 



it^a* 1 Hi*-*-* A^J^r- 9 k * k 

^nnwaaub&pf arss wtma s 2 iaTT» o . 

[0023] JUT. *fKB^«Wt<OJB!Btov^TH 1 * l 

[0024] (njfiojg®. i ) m-<7mm<7)mmco^p 
smat\t< m 1 tc^-r i a t, 
*a3j«i. wmAtt6m&m^Ajjm2. mw> 
^ft^%co^pfr^MT&&mzmiiiLxmm^9 

«K**ffl LtfB^s7«£E««mi 3 . 

g«§§ft*:iS#0#JSk A^^tf^WH** JKfti LTft 
***«saS#*WB»»4. A*«MR3&»4»e«<OiKR 

i££»ft^£jgMi^ajg&9. wk<9Mjm^>mm 

r-?£iS#tf>£ii!f. fcU<*as«WIl3-]«kfct>fc 

ten-f smb&x-?<-.x 1 1 . mmmmmtm 

W&T-9K-X 1 1 j&»4>AA-f4B«-r-**Jt«L 

3. naNHni4, mmuomi om>^m^tn 

[0025]*fc, ttfeB#*J«SiRtf4tiL A* L£ 

**J»«W»6, IWxv^a^^-r/WfJcJjOA**^ 
tWWf-9 t<nffi(T>mi&cr>®.imi:%& IX tH 

irrbWBmmt&7 * im.<omw^^^T-9 
zmnn&m. i>l< im%mw a - Hkki (cie«-r 

[0026] ^O^a-C'{4. ^PXttB 1 tcA* Lfelg 

gS4 rt^»^»M»(c7J!i-r * . wpwmK 6 nth* 

«, «WB«BM!»7fc:A*L. MSNWH*70(B 

[0027] *«fi#AA«2fc:A* LfcB*!0««r* 
trtUUi. «KR«ffi*»9t=A*L, ^MHSttajg|59«o 
ab^(4B«it«SS 1 0 tc A* t . BtUtlSlfl 1 0 comtl 

i&tPBmmm i t«N*s . * . a®Jt®^ 1 

[0028] ^RfJgSS*WJ*B»»3 . #^IS#^^fS 

ma54. am«^i o^oai^Ji. e&tt&Riteffstc 
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aau tmt&&^5&MiwmM&mjj2ti 

/yy^y^IIl, A-L pp. 1-6. rfefif 
^kGAfcfflV^Mffi&ttffikilA^OJEEj fcifJC 

ttt>, VTflMSffi^AHXB, d-2. Vo 

1. , J76-D-2. No. 6. pp. 1132 — 1 

139. rqEir-f ^fc-jL-?*** hzm^tzmw®. 

(Qimi Zklz^ZixX^Z. ifc, i5LJt««*ffl 
if vc . IM««AJIMHC3Nffl^-« £ k ttttflPFS - 1 

7086 6^jm. - s 6 1 i 1 

[ 0 0 2 9 ] 4fc, *J*BHWSS*7 IzHtf hWm<n 

a t f £ k # (c, fi83iufc»# i cot^T^^x- 
^jfcitLT. a ■ Ri • R'i,jkR"j£S:£iJU -tO 

HlkLTtlJ7Jiri>. 

[00 30] fi^aii. t|Sf-^^-X8(: 

SSS LfcWjS-r-? k tiSiJC , W/Sr- 8 

fcAai*^fc**:k4»0MB*£JtttLT. fS#£ 

[0031] (mm<v&m2 > £ofri»BflBaEf±B2 
©k^-j^ic. ffl^ttffise9*^ai7j$ix§is^«os 
«nK«tt A7J l . mm^mmmtam 9 km t^mz 

as«i 2, mmmttuti&i 2*^ai7j$iii>fs^)p# 

JBffl3k, SattfDJB»lfcRt<*^«HI»6, 

saunas 7 % w^7-'-^<-^8*^«fi!tsai.^ 

K##*Bia»7, Wf»A7JfWSl . W&m*7 A7JSB 



2 , :ra£ss#W)*isaHi:3 , mmmrna 9 . ®att 
•aw i o . igi6fe^^J 5 v ^ . 

[0032 3 £<3«Cli. #^A7J^ 1 fcA* LfcfS 
#^J»«i WjaS*BBW 3 k tt££#&8tt4 rttfO 
^^^6t;A7)-rS. *WMifflI6<oaj*tt, Wf§ 
B«Mffl»7*cA*L. «*BW®a*7<oai*«. w 

j*E»BBlffi 7 k ^T-fK-X 8 JiSV *fc«tt$*l 

*wi, si«^aj7jgi59tcA7jL. ga^^tttfi^p 9 c7>ai73 
t««it!&gi5 1 o kwmtmmm i 2 ica* t . am 
i^io^a*iiffj*BaBe^7(cieR$ii&. 4 

[0033] mwmtami 2<am:*jH«»st«ii»i 
3(ca*u mm^mta^i 3coiatni. ^mmnsm 
»7t=AA-r*. wshs#&j»bm»3. i$£|$jhf 

5 izxts t . enttKa^ff 5 a> ^>(4f2i^m*>'a}7j $ 
n*. #»^«!ai^i 3-m. wmtmta^i 2xmta 

K=l 
K = 0 

COM^ i <7)#^f-'-^ j iztt LX . 
or • K - Ri - R'i,ji:R"j 

[0034] 3 izm%m%^mm<7)ttizi5^ 
x. x-nvm<,z&$.tLhm%<rm<rm*zik$i-?hzk 

CJ:"9, A7JBJl®^lgCO^^H^4ixTV^i:^ 
[0035] (9m?>mm3 ) £05IS«il3tC^J: 

aj-*-*«»u^M»aj* 14k. mm<mm 2 kn t 

ma57. w^ATj^gpi. ««fi#A*»2, 
is#w^i2iigi5 3 . mmmrntam 9 , amjt^git 1 0 . 
isis«£*^^5. #M^»ai^i 2. s»#t&fcgi5i 

[00363 £^ar-c*i» w^atj^ 1 izxii Ltzm 
*o«^ii^w«e«Batt» 3 k #^§^igisgi54 p^co 

mmmt$7izxfiL. 'mrnxmumatfui. m 
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UBfiUtlHB 1 0 tWm®Mft& 1 2 £A* U BflUt 

teat i o (D&jjtemjmmm® i tesmztu . * 

MWWW7 fci«**lTV>t. 

a*u ummm^sfrbtisamm&mtozti 
*. 1 3Ti4. BfRtftAfflai 2t 

K=l 
K = 0 

L=l 
L = 0 

a • K ■ L ■ Ri ■ R'i,j£:R"j 
[0038] ^co «k o (c«fjeK««J»BMlW^Cfc*JV^ 

[0039] (mM<7)MB4 ) £<9£miH4 fcjjrf <fc 

1 8 1 . m&comm itnt< *«83* 6 * ^-f- 

f2H&4 fc , *M9#Afl# 1 , tt*M3-*A*»2 . 
*WSEIS**WMW8 3 b . M«ftS«ffig|59 fc . Bt&Jt 

[0040] znmmTii, mmmAjj® 1 5 ka* t 



taasas 1 s w£#&§as 1 9 tanMtr-* 

iss#B»»4rt^)e^«Biaf6fcA*'f*. wayias 

6 <OSJ . ^fgaSffiSS 7 A* L . ^-PlS^rai 

»j*B»WI»7i:**7 r --^-.X8 
«5V >fc»tt$ ftT n * . «wwi#a*» 2 1 A* Lfc 
IS#<9fi$- , iHHWiB** 9 fcA* L > Kff 

JittHlgP 9 otttfJUBfUtlti* 1 0 CAA L . BttJttt 
f 1 0«U*l4f«HWW7S«i8ft4. *3t. 
BflUfctK» 1 0 tm&T-7^-X 1 1 fc«2V^S« 

[0041] T^jm&gmmm . «5eis«*W8 
ssgf4. Mfttt«sin o^atiJi. Bamstt^«5t: 
aa t , ssmsMtt&m 5 ^^ttBwsswas* 

*?»«^A*»lfci«flMS#A*«2tt, * 

tsaw*. toi^=s^ajiii5i 7ii. sffl^ia^i 6ic 
m*««o4ir : f-^*ffi*-r*. a«wa«Ki8a. 

^JJt3Sgl5 1 7 frbttiJj-ft, itiMmco&MT- fiiitlz 

LT, B«Jt«S51 2^fcffl*SHi:4. MB«lt^ 1 
0TI4, TV«ft^ffl«#kWS«iut«fc«)l6#«t 
UT, k#g<7)ig#^KH«x-^tA*B*^C=-^ati 

w«aHaffl«9 *»4,as*^* wiftx-^ t tfsra^wH 

W^r-^ J k. A*#^i:«««K*R'k.j*JWJU 

L-CfSSLitWH/^-^fcASJ^kiOlBl^ftK 
R"J«MJU as*-f*. ^^BMfflWJt^BT-li. 

a Rk- R'-k.jfcR" j 

[ 0 0 4 2 ] iOcfc 3 fc:»«K«*WBII^)*^fci3V» 
T s «H«7*-^Sr*t:TV«|i<oaj»#*«seL, w 

ftsw&ajaw^wiaf-^fc Tv«ai*«i=***i 

Zs&&<7>mW&ZimLX. Zb£X 
HTRWUfc* 1 , VTR • \L?*i&nimZ&7F?hli 

cox'$>titinx'i>mh%\,\ 
[0043] ( mmco&m 5 ) £ (nmmtm 5 izm-tx 
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< (ifS^HS'Jo- h* fc i; fc £ |Bi| U *»offffllcSB« 
1 l, MBffix-:?^-* 1 He 

t — 9 t:mmmthtz»><Dfsm^ a mmm* i 9 

[0044] Z<D$m.Ti±. ^PAJl® 1 IZAJi Ltzm 

mmn&mm izxjjl. ^jsw^smm ornate. & 
ami. w»*ai:aaii9tcA±u Mii«ttaiai9oaj^ 

teBMJts&gB 1 0 £A* L , ®«Jt«egP 1 0 <7)&jjiZ% 

pmmmmnzmm^tii. tti. mmtm^i ot 
am^-^^-x 1 1 tnK^zmmztix^z,. 
Etttffptam 3 . ®%m&gmm%i4 , mutis 
i o commit. wsmim&a 5 tcA* t , vamm 

^m^-^<-x8bmmmy i -^^-xi nzm 

[0045] wmmmn i otn gmtifrmw 
mmiztt lx . i &3<nm%cr>mmM7- 9 1 xtsvm 
iz&t timmwmm^9^hiii^-ti,mmmy t -9 1 o 
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